Mobile terminal and control method thereof

ABSTRACT

The present disclosure provides a mobile terminal, including a first camera and a second camera that are configured to operate simultaneously, a display unit that is configured to output a first image captured by the first camera and at least part of a second image captured by the second camera in an overlaying manner, and a controller that is configured to set an output position of the at least part of the second image in a manner of preventing the at least part of the second image from being overlaid on a specific object included in the first image.

CROSS-REFERENCE TO RELATED APPLICATION

Pursuant to 35 U.S.C. §119(a), this application claims the benefit ofearlier filing date and right of priority to Korean Application No.10-2013-0134327, filed on Nov. 6, 2013, the contents of which isincorporated by reference herein in its entirety.

BACKGROUND OF THE DISCLOSURE

1. Field of the Disclosure

This specification relates to a mobile terminal having a plurality ofcameras simultaneously operating in a dual capturing mode, and a controlmethod thereof.

2. Background of the Disclosure

Mobile terminals are electronic devices which are portable and have atleast one of voice and telephone call functions, information inputand/or output functions, a data storage function and the like.

As it becomes multifunctional, the mobile terminal can be allowed tocapture still images or moving images, play music or video files, playgames, receive broadcast and the like, so as to be implemented as anintegrated multimedia player.

Many efforts are undergoing to support and enhance various functions assuch multimedia player in view of hardware or software improvements. Asone example, a user interface environment is provided in order for usersto easily and conveniently search for or select functions.

Meanwhile, the mobile terminal may be provided with a plurality ofcameras to capture a still image or a video. In a dual capturing mode inwhich those cameras are operating simultaneously, images captured by theplurality of cameras, respectively, may be output on a display unit.

In general, in the dual capturing mode, one camera captures an object,and another camera captures a user. Here, when the user views an imagewith the object captured, the user may suffer from caring for the user'sown image. This may cause a difficulty for the user to make for adesired composition. It may be considerably difficult to capture animage with appropriately adjusting a distance between the one camera andthe object and a distance between the another camera and the user. Thismay be especially so when the object or the user moves to a differentposition.

SUMMARY OF THE DISCLOSURE

Therefore, an aspect of the detailed description is to provide a mobileterminal, capable of selecting an output position of an image, which iscaptured by another camera, based on a position of a specific objectincluded in an image captured by one camera, and a control methodthereof.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a mobile terminal, including a first camera and a secondcamera that are configured to operate simultaneously in a dual capturingmode, a display unit that is configured to output a first image capturedby the first camera and at least part of a second image captured by thesecond camera in an overlaying manner in the dual capturing mode, and acontroller that is configured to set an output position of the at leastpart of the second image in a manner of preventing the at least part ofthe second image from being overlaid on a specific object included inthe first image.

In accordance with one exemplary embodiment disclosed herein, thespecific object may be a face of a person included in the first image,and the controller may detect a background area excluding the person'sface, so as to place the at least part of the second image on thebackground area.

The controller may divide the background area into a plurality of areasavoiding the person's face, and place the at least part of the secondimage within one of the plurality of areas.

In accordance with another exemplary embodiment disclosed herein, the atleast part of the second image may be changed in position, without beingoverlaid on the specific object in a continuous manner, when a positionof the specific object output on the display unit is changed.

In accordance with another exemplary embodiment disclosed herein, asetting screen for changing a setting of the controller may be outputwhen the at least part of the second image is touched.

In accordance with another exemplary embodiment disclosed herein, in astate where the at least part of the second image is output on thedisplay unit without being overlaid on the specific object, when thespecific object is selected by a preset touch input, the at least partof the second image may be output to be overlaid on the specific object.

The preset touch input may include a touch input that the at least partof the second image is touched and then dragged to be moved. The atleast part of the second image may be output to be overlaid on thespecific object when the at least part of the second image approachesthe specific object within a predetermined range.

When the at least part of the second image approaches the specificobject within the predetermined range, the at least part of the secondimage may be attracted to the specific object and located to be overlaidon the specific object even though the touch applied to the at leastpart of the second image is released.

At least one of a position and a size of the at least part of the secondimage may be changed while the at least part of the second image isoverlaid on the specific object, when the at least one of a position anda size of the specific object output on the display unit is changed.

In accordance with another exemplary embodiment disclosed herein, in astate where the at least part of the second image is output on thedisplay unit without being overlaid on the specific object, when thespecific object is selected, the at least part of the second image maybe output with a preset interval from the specific object.

When the specific object is moved, the at least part of the second imagemay be moved with maintaining the preset interval from the specificobject.

The preset interval may be set based on a preset touch input. The presettouch input may include a start point where the at least part of thesecond image is touched, and a release point where the touch is releasedafter the at least part of the second image is dragged in the touchedstate. The controller may set an interval between the specific objectand the release point as the preset interval.

In accordance with another exemplary embodiment disclosed herein, thecontroller may detect a face of a person included in the second image,and place the person's face within at least part of the first image.

The controller may detect a face of a person captured by the secondcamera, and set the at least part of the second image output on thedisplay unit based on the detected person's face.

In accordance with another exemplary embodiment disclosed herein, thespecific object may be a face of a person located within the firstimage, and the controller may adjust a size of a person's face locatedwithin the at least part of the second image according to the size ofthe person's face located within the first image.

To achieve these and other advantages and in accordance with the purposeof this specification, as embodied and broadly described herein, thereis provided a control method for a mobile terminal, including acquiringa first image and a second image by a first camera and a second camera,respectively, in a dual capturing mode, setting a relative outputposition of the second image with respect to the first image based on aspecific object included in the first image, and outputting the secondimage on a display unit in a manner of overlaying the second image onthe first image based on the setting.

In accordance with one exemplary embodiment disclosed herein, thesetting step may include setting the output position in a manner thatthe second image is prevented from being overlaid on the specificobject.

In accordance with another exemplary embodiment disclosed herein, thesetting step may include changing the output position of the secondimage based on a position change of the specific object when theposition change of the specific object output on the display unit iscaused.

In accordance with another exemplary embodiment disclosed herein, thesetting step may include detecting a person's face located within thesecond image, and placing the detected person's face on a centralportion of the first image.

The setting step may include detecting faces of persons included in thefirst and second images, and adjusting the size of the person's faceincluded in the second image according to the size of the person's faceincluded in the first image.

Further scope of applicability of the present application will becomemore apparent from the detailed description given hereinafter. However,it should be understood that the detailed description and specificexamples, while indicating preferred embodiments of the disclosure, aregiven by way of illustration only, since various changes andmodifications within the spirit and scope of the disclosure will becomeapparent to those skilled in the art from the detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the disclosure and are incorporated in and constitute apart of this specification, illustrate exemplary embodiments andtogether with the description serve to explain the principles of thedisclosure.

In the drawings:

FIG. 1 is a block diagram of a mobile terminal in accordance with oneexemplary embodiment of the present disclosure;

FIG. 2A is a front perspective view of one example of a mobile terminalaccording to the present disclosure;

FIG. 2B is a rear perspective view of the mobile terminal illustrated inFIG. 2A;

FIGS. 3 and 4 are conceptual views illustrating a dual capturing modefor capturing images by simultaneously operating first and secondcameras illustrated in FIGS. 2A and 2B;

FIGS. 5 to 7 are conceptual views illustrating a method of selecting anautomated position of a floating window, on which an image captured bythe second camera is output, in the mobile terminal in accordance withthe one exemplary embodiment;

FIGS. 8 to 10 are conceptual views illustrating a continuous executionof an automatic position selection for the floating window in the mobileterminal in accordance with the one exemplary embodiment;

FIGS. 11 and 12 are conceptual views illustrating an automatic sizesetting for the floating window in the mobile terminal in accordancewith the one exemplary embodiment;

FIGS. 13A, 13B and 14 are conceptual views illustrating a method ofmaintaining a state that the floating window is overlaid on a specificobject in the mobile terminal in accordance with the one exemplaryembodiment;

FIGS. 15 and 16 are conceptual views illustrating a method ofmaintaining a preset interval between the floating window and adesignated specific object in the mobile terminal in accordance with theone exemplary embodiment;

FIGS. 17 to 19 are conceptual views illustrating a method of alwaysputting a specific object, which is included in a second image capturedby the second camera, within the floating window in the mobile terminalin accordance with the one exemplary embodiment; and

FIGS. 20 to 22 are conceptual views illustrating a method of outputtinga specific object, which is included in a second image captured by thesecond camera, in a manner of adjusting a size of the specific object tobe appropriate for the floating window according to sizes of objectsincluded in a first image captured by the first camera in the mobileterminal in accordance with the one exemplary embodiment.

DETAILED DESCRIPTION OF THE DISCLOSURE

Description will now be given in detail of a mobile terminal and acontrol method thereof according to the exemplary embodiments, withreference to the accompanying drawings.

For the sake of brief description with reference to the drawings, thesame or equivalent components will be provided with the same referencenumbers, and description thereof will not be repeated. A suffix “module”and “unit” used for constituent elements disclosed in the followingdescription is merely intended for easy description of thespecification, and the suffix itself does not give any special meaningor function.

In describing the present disclosure, if a detailed explanation for arelated known function or construction is considered to unnecessarilydivert the gist of the present disclosure, such explanation has beenomitted but would be understood by those skilled in the art. Theaccompanying drawings are used to help easily understand the technicalidea of the present disclosure and it should be understood that the ideaof the present disclosure is not limited by the accompanying drawings.

Mobile terminals described herein may include cellular phones, smartphones, laptop computers, digital broadcasting terminals, personaldigital assistants (PDAs), portable multimedia players (PMPs),navigators, slate PCs, tablet PCs, ultra books, and the like. However,it may be easily understood by those skilled in the art that theconfiguration according to the exemplary embodiments of thisspecification can also be applied to stationary terminals such asdigital TV, desktop computers and the like, excluding a case of beingapplicable only to the mobile terminals.

FIG. 1A is a block diagram of a mobile terminal in accordance with thepresent disclosure.

The mobile terminal 100 may include a wireless communication unit 110,an Audio/Video (A/V) input unit 120, a user input unit 130, a sensingunit 140, an output unit 150, a memory 160, an interface unit 170, acontroller 180, a power supply unit 190, and the like. However, all ofthe elements as illustrated in FIG. 1 are not necessarily required, andthe mobile terminal may be implemented with greater or less number ofelements than those illustrated elements.

Hereinafter, the constituent elements will be described in turn.

The wireless communication unit 110 typically includes one or moreelements allowing radio communication between the mobile terminal 100and a wireless communication system, or allowing radio communicationbetween the mobile terminal 100 and a network in which the mobileterminal 100 is located. For example, the wireless communication unit110 may include a broadcast receiving module 111, a mobile communicationmodule 112, a wireless Internet module 113, a short-range communicationmodule 114, a location information module 115, and the like.

The broadcast receiving module 111 receives broadcast signals and/orbroadcast associated information from an external broadcast managementserver through a broadcast channel.

The broadcast channel may include a satellite channel and/or aterrestrial channel. The broadcast management server may mean a serverthat generates and transmits a broadcast signal and/or broadcastassociated information or a server that receives a previously generatedbroadcast signal and/or broadcast associated information and transmitsto the mobile terminal 100. The broadcast signal may include a TVbroadcast signal, a radio broadcast signal and a data broadcast signalas well as a broadcast signal in a form that a data broadcast signal iscoupled to the TV or radio broadcast signal.

The broadcast associated information may mean information regarding abroadcast channel, a broadcast program, a broadcast service provider,and the like. The broadcast associated information may also be providedthrough a mobile communication network, and in this case, the broadcastassociated information may be received by the mobile communicationmodule 112.

The broadcast associated information may exist in various forms. Forexample, it may exist in the form of an electronic program guide (EPG)of digital multimedia broadcasting (DMB), electronic service guide (ESG)of digital video broadcast-handheld (DVB-H), and the like.

The broadcast receiving module 111 may receive a broadcast signal usingvarious types of broadcast systems. In particular, the broadcastreceiving module 111 may receive a digital broadcast signal using adigital broadcast system such as digital multimediabroadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), media forward link only (MediaFLO),digital video broadcast-handheld (DVB-H), integrated services digitalbroadcast-terrestrial (ISDB-T), and the like. The broadcast receivingmodule 111 is, of course, configured to be suitable for every broadcastsystem that provides a broadcast signal as well as the above-mentioneddigital broadcast systems.

Broadcast signals and/or broadcast associated information received viathe broadcast receiving module 111 may be stored in a suitable device,such as a memory 160.

The mobile communication module 112 transmits and/or receives a radiosignal to and/or from at least one of a base station, an externalterminal and a server over a mobile communication network. In thisexemplary embodiment, the radio signal may include a voice call signal,a video call signal and/or various types of data according to textand/or multimedia message transmission and/or reception.

The mobile communication module 112 may implement a video call mode anda voice call mode. The video call mode indicates a state of calling withwatching a callee's image. The voice call mode indicates a state ofcalling without watching the callee's image. The wireless communicationmodule 112 may transmit and receive at least one of voice and image inorder to implement the video call mode and the voice call mode.

The wireless Internet module 113 supports wireless Internet access forthe mobile terminal. This module may be internally or externally coupledto the mobile terminal 100. Examples of such wireless Internet accessmay include Wireless LAN (WLAN) (Wi-Fi), Wireless Broadband (Wibro),Worldwide Interoperability for Microwave Access (Wimax), High SpeedDownlink Packet Access (HSDPA) and the like.

The short-range communication module 114 denotes a module forshort-range communications. Suitable technologies for implementing thismodule may include BLUETOOTH™, Radio Frequency IDentification (RFID),Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee™, and thelike.

The location information module 115 denotes a module for detecting orcalculating a position of a mobile terminal. An example of the locationinformation module 115 may include a Global Position System (GPS)module.

Still referring to FIG. 1, the A/V input unit 120 is configured toprovide audio or video signal input to the mobile terminal. The A/Vinput unit 120 may include a camera 121 and a microphone 122. The camera121 receives and processes image frames of still pictures or videoobtained by image sensors in a video call mode or a capturing mode. Theprocessed image frames may be displayed on a display unit 151.

The image frames processed by the camera 121 may be stored in the memory160 or transmitted to the exterior via the wireless communication unit110. Also, user's position information and the like may be calculatedfrom the image frames acquired by the camera 121. Two or more cameras121 may be provided according to the configuration of the mobileterminal.

The microphone 122 may receive an external audio signal while the mobileterminal is in a particular mode, such as a phone call mode, a recordingmode, a voice recognition mode, or the like. This audio signal isprocessed into digital data. The processed digital data is converted foroutput into a format transmittable to a mobile communication basestation via the mobile communication module 112 in case of the phonecall mode. The microphone 122 may include assorted noise removingalgorithms to remove noise generated in the course of receiving theexternal audio signal.

The user input unit 130 may generate input data input by a user tocontrol the operation of the mobile terminal. The user input unit 130may include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch and the like.

The sensing unit 140 provides status measurements of various aspects ofthe mobile terminal. For instance, the sensing unit 140 may detect anopen/close status of the mobile terminal, a change in a location of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, the location of the mobile terminal 100,acceleration/deceleration of the mobile terminal 100, and the like, soas to generate a sensing signal for controlling the operation of themobile terminal 100. For example, regarding a slide-type mobileterminal, the sensing unit 140 may sense whether a sliding portion ofthe mobile terminal is open or closed. Other examples include sensingfunctions, such as the sensing unit 140 sensing the presence or absenceof power provided by the power supply 190, the presence or absence of acoupling or other connection between the interface unit 170 and anexternal device.

The output unit 150 is configured to output an audio signal, a videosignal or a tactile signal. The output unit 150 may include a displayunit 151, an audio output module 152, an alarm unit 153 and a hapticmodule 154.

The display unit 151 may output information processed in the mobileterminal 100. For example, when the mobile terminal is operating in aphone call mode, the display unit 151 will provide a User Interface (UI)or a Graphic User Interface (GUI), which includes information associatedwith the call. As another example, if the mobile terminal is in a videocall mode or a capturing mode, the display unit 151 may additionally oralternatively display images captured and/or received, UI, or GUI.

The display unit 151 may be implemented using, for example, at least oneof a Liquid Crystal Display (LCD), a Thin Film Transistor-Liquid CrystalDisplay (TFT-LCD), an Organic Light-Emitting Diode (OLED), a flexibledisplay, a three-dimensional (3D) display, an e-ink display or the like.

Some of such displays 151 may be implemented as a transparent type or anoptical transparent type through which the exterior is visible, which isreferred to as ‘transparent display’. A representative example of thetransparent display may include a Transparent OLED (TOLED), and thelike. The rear surface of the display unit 151 may also be implementedto be optically transparent. Under this configuration, a user can viewan object positioned at a rear side of a terminal body through a regionoccupied by the display unit 151 of the terminal body.

The display unit 151 may be implemented in two or more in numberaccording to a configured aspect of the mobile terminal 100. Forinstance, a plurality of the displays 151 may be arranged on one surfaceto be spaced apart from or integrated with each other, or may bearranged on different surfaces.

Here, if the display unit 151 and a touch sensitive sensor (referred toas a touch sensor) have a layered structure therebetween (referred to asa ‘touch screen’), the display unit 151 may be used as an input deviceas well as an output device. The touch sensor may be implemented as atouch film, a touch sheet, a touchpad, and the like.

The touch sensor may be configured to convert changes of a pressureapplied to a specific part of the display unit 151, or a capacitanceoccurring from a specific part of the display unit 151, into electricinput signals. Also, the touch sensor may be configured to sense notonly a touched position and a touched area, but also touch pressure.

When touch inputs are sensed by the touch sensors, corresponding signalsare transmitted to a touch controller. The touch controller processesthe received signals, and then transmits corresponding data to thecontroller 180. Accordingly, the controller 180 may sense which regionof the display unit 151 has been touched.

Still referring to FIG. 1, a proximity sensor may be arranged at aninner region of the mobile terminal 100 covered by the touch screen, ornear the touch screen. The proximity sensor may be provided as oneexample of the sensing unit 140. The proximity sensor indicates a sensorto sense presence or absence of an object approaching to a surface to besensed, or an object disposed near a surface to be sensed, by using anelectromagnetic field or infrared rays without a mechanical contact. Theproximity sensor has a longer lifespan and a more enhanced utility thana contact sensor.

The proximity sensor may include a transmissive type photoelectricsensor, a direct reflective type photoelectric sensor, a mirrorreflective type photoelectric sensor, a high-frequency oscillationproximity sensor, a capacitance type proximity sensor, a magnetic typeproximity sensor, an infrared rays proximity sensor, and so on. When thetouch screen is implemented as a capacitance type, proximity of apointer to the touch screen is sensed by changes of an electromagneticfield. In this case, the touch screen (touch sensor) may be categorizedinto a proximity sensor.

Hereinafter, for the sake of brief explanation, a status that thepointer is positioned to be proximate onto the touch screen withoutcontact will be referred to as ‘proximity touch’, whereas a status thatthe pointer substantially comes in contact with the touch screen will bereferred to as ‘contact touch’. For the position corresponding to theproximity touch of the pointer on the touch screen, such positioncorresponds to a position where the pointer faces perpendicular to thetouch screen upon the proximity touch of the pointer.

The proximity sensor may sense proximity touch, and proximity touchpatterns (e.g., distance, direction, speed, time, position, movingstatus, etc.). Information relating to the sensed proximity touch andthe sensed proximity touch patterns may be output onto the touch screen.

The audio output module 152 may convert and output as sound audio datareceived from the wireless communication unit 110 or stored in thememory 160 in a call signal reception mode, a call mode, a record mode,a voice recognition mode, a broadcast reception mode, and the like.Also, the audio output module 152 may provide audible outputs related toa particular function performed by the mobile terminal 100 (e.g., a callsignal reception sound, a message reception sound, etc.). The audiooutput module 152 may include a receiver, a speaker, a buzzer or thelike.

The alarm unit 153 outputs signals notifying occurrence of events fromthe mobile terminal 100. The events occurring from the mobile terminal100 may include a call received, a message received, a key signal input,a touch input, and the like. The alarm unit 153 may output not onlyvideo or audio signals, but also other types of signals such as signalsnotifying occurrence of events in a vibration manner. Since the video oraudio signals can be output through the front display unit 151 or theaudio output unit 152, the front display unit 151 and the audio outputmodule 152 may be categorized into a part of the alarm unit 153.

The haptic module 154 generates various tactile effects which a user canfeel. A representative example of the tactile effects generated by thehaptic module 154 includes vibration. Vibration generated by the hapticmodule 154 may have a controllable intensity, a controllable pattern,and so on. For instance, different vibration may be output in asynthesized manner or in a sequential manner.

The haptic module 154 may generate various tactile effects, includingnot only vibration, but also arrangement of pins vertically moving withrespect to a skin being touched (contacted), air injection force or airsuction force through an injection hole or a suction hole, touch by askin surface, presence or absence of contact with an electrode, effectsby stimulus such as an electrostatic force, reproduction of cold or hotfeeling using a heat absorbing device or a heat emitting device, and thelike.

The haptic module 154 may be configured to transmit tactile effects(signals) through a user's direct contact, or a user's muscular senseusing a finger or a hand. The haptic module 154 may be implemented intwo or more in number according to the configuration of the mobileterminal 100.

The memory 160 may store a program for the processing and control of thecontroller 180. Alternatively, the memory 160 may temporarily storeinput/output data (e.g., phonebook data, messages, still images, videoand the like). Also, the memory 160 may store data related to variouspatterns of vibrations and audio output upon the touch input on thetouch screen.

The memory 160 may be implemented using any type of suitable storagemedium including a flash memory type, a hard disk type, a multimediacard micro type, a memory card type (e.g., SD or DX memory), RandomAccess Memory (RAM), Static Random Access Memory (SRAM), Read-OnlyMemory (ROM), Electrically Erasable Programmable Read-only Memory(EEPROM), Programmable Read-only Memory (PROM), magnetic memory,magnetic disk, optical disk, and the like. Also, the mobile terminal 100may operate a web storage which performs the storage function of thememory 160 on the Internet. The interface unit 170 may generally beimplemented to interface the mobile terminal 100 with external devices.The interface unit 170 may allow a data reception from an externaldevice, a power delivery to each component in the portable terminal 100,or a data transmission from the portable terminal 100 to an externaldevice. The interface unit 170 may include, for example, wired/wirelessheadset ports, external charger ports, wired/wireless data ports, memorycard ports, ports for coupling devices having an identification module,audio Input/Output (I/O) ports, video I/O ports, earphone ports, and thelike.

The identification module may be configured as a chip for storingvarious information required to authenticate an authority to use themobile terminal 100, which may include a User Identity Module (UIM), aSubscriber Identity Module (SIM), and the like. Also, the device havingthe identification module (hereinafter, referred to as ‘identificationdevice’) may be implemented in a type of smart card. Hence, theidentification device can be coupled to the mobile terminal 100 via aport.

Also, the interface unit 170 may serve as a path for power to besupplied from an external cradle to the mobile terminal 100 when themobile terminal 100 is connected to the external cradle or as a path fortransferring various command signals inputted from the cradle by a userto the mobile terminal 100. Such various command signals or powerinputted from the cradle may operate as signals for recognizing that themobile terminal 100 has accurately been mounted to the cradle.

The controller 180 typically controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with telephony calls, datacommunications, video calls, and the like. The controller 180 mayinclude a multimedia module 181 which provides multimedia playback. Themultimedia module 181 may be configured as part of the controller 180 oras a separate component.

The controller 180 can perform a pattern recognition processing so as torecognize writing or drawing input on the touch screen as text or image.

The controller 180 may also execute a lock state in which a user isrestricted from inputting a control command for applications when astate of the mobile terminal meets a set condition. Also, the controller180 may control a lock screen displayed in the lock state based on atouch input sensed on the display unit 151.

The power supply 190 provides power required by various components underthe control of the controller 180. The provided power may be internalpower, external power, or combination thereof.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, software, hardware, or somecombination thereof.

For a hardware implementation, the embodiments described herein may beimplemented within one or more Application Specific Integrated Circuits(ASICs), Digital Signal Processors (DSPs), Digital Signal ProcessingDevices (DSPDs), Programmable Logic Devices (PLDs), Field ProgrammableGate Arrays (FPGAs), processors, microprocessors, other electronic unitsdesigned to perform the functions described herein, or a selectivecombination thereof. In some cases, such embodiments are implemented bythe controller 180.

For software implementation, the embodiments such as procedures andfunctions may be implemented together with separate software moduleseach of which performs at least one of functions and operations.

The software codes can be implemented with a software applicationwritten in any suitable programming language. Also, the software codesmay be stored in the memory 160 and executed by the controller 180.

FIG. 2A is a front perspective view of a mobile terminal 100 inaccordance with one exemplary embodiment.

The mobile terminal 100 shown in FIG. 2 has a bar type terminal body.However, this detailed description may be applicable, but not limitedto, a watch type, a clip type, a glass type, or a various structures,such as a slide type, a folder type, a swing type, a swivel type and thelike, having two or more bodies coupled to be relatively movable witheach other.

The terminal body may include a case (or referred to as casing, housing,cover, etc.) defining an appearance of the mobile terminal 100. In thisexemplary embodiment, a main body may be divided into a front case 101and a rear case 102. Various electronic components may be mounted in aspace formed between the front case 101 and the rear case 102. A cover103 may be coupled to the front or rear case 101 or 102 to define a rearappearance of the mobile terminal 100.

Such cases may be injected using a synthetic resin or be formed of ametal, such as stainless steel (STS), titanium (Ti), aluminum (Al) orthe like.

The front surface of the terminal body is shown having a display unit151, a proximity sensor 141, a light sensor 142, a first audio outputmodule 152 a, a camera 121 b, a first manipulation unit 131 and thelike, and a side surface thereof is shown having a microphone 122, aninterface unit 170, a second manipulation unit 132 and the like.

The display unit 151 may output information processed in the mobileterminal 100. The display unit 151 may be implemented to display(output) visual information using, for example, at least one of a LiquidCrystal Display (LCD), a Thin Film Transistor-Liquid Crystal Display(TFT-LCD), an Organic Light-Emitting Diode (OLED), a flexible display, athree-dimensional (3D) display, an e-ink display or the like.

The display unit 151 may include a touch sensing unit for receiving acontrol command input in a touch manner. When a portion on the displayunit 151 is touched, the touch sensing unit may sense the touch inputand a content corresponding to the touched portion may be input. Thecontents input in the touch manner may include text or numerals or menuitems which are instructed or selected in various modes.

Touch sensing unit may be transparent such that visual informationoutput on the display unit 151 can be viewed, and have a structure forenhancing visibility of a touch screen at a bright place. In FIG. 1, thedisplay unit 151 may occupy most of the front surface of the front case101.

The proximity sensor 141, the light sensor 142, the first audio outputmodule 152 a and the camera 121 b may be disposed at a region adjacentto one of both end portions of the display unit 150, and the firstmanipulation unit 131 and the microphone 122 may be disposed at a regionadjacent to another end. A second manipulation unit 132 (see FIG. 2), aninterface unit 170 and the like may be disposed at a side surface of theterminal body.

The proximity sensor 141 may detect whether or not an object existswithin a predetermined detection area, and be used to control othercomponents including the display unit 151. As one example, the proximitysensor 141 may be disposed adjacent to the display unit 151 to controlthe display unit 151 to be deactivated when a user puts the terminalbody onto his face to place or receive a call.

The light sensor 142 may sense brightness of ambient light of theterminal body. The mobile terminal 100 may automatically adjust lightingof the display unit 151 according to an amount of ambient light usingthe light sensor 142.

The first audio output module 152 a may be implemented as a receiver totransfer a call sound to a user's ear, or a loud speaker for outputtingvarious alarm sounds or multimedia reproduction sounds.

Sounds generated from the first audio output module 152 a may be emittedthrough an assembly gap between structures. Here, a separately formedhole for outputting sounds may not be viewed or be hidden from theoutside, thereby more simplifying the appearance of the terminal 100.

The camera 121 b may process image frames of still pictures or videoobtained by image sensors in a video call mode or a capturing mode. Theprocessed image frames may be displayed on a display unit 151.

A user input unit may be manipulated to allow inputting of commands forcontrolling operations of the mobile terminal 100, and include first andsecond manipulation units 131 and 132. The first and second manipulationunits 131 and 132 may be referred to as a manipulating portion. Suchmanipulating portion can employ any tactile manner that a user cantouch, push, scroll or the like for manipulation.

The drawings illustrate the first manipulation unit 131 as a touch key,but the present disclosure may not be limited to the type. For example,the first manipulation unit 131 may be implemented as a mechanical keyor a combination of a touch key and the mechanical key.

Contents input by the first and second manipulation units 131 and 132may be set variously. For example, the first manipulation unit 131 maybe configured to input commands such as menu, home, cancel, search orthe like, and the second manipulation unit 132 may be configured toinput commands, such as a volume adjustment of sounds output from thefirst audio output module 160, conversion of the display unit 150 into atouch recognition mode, or the like.

The microphone 122 may receive user's voice, other sounds and the like.The microphone 122 may be disposed in various places to receive stereosound.

The interface unit 170 may serve as a path for data exchange between themobile terminal 100 and external devices. For example, the interfaceunit 170 may be at least one of wired/wireless earphone ports, ports forshort-range communication (e.g., IrDA, Bluetooth, WLAN, etc.), powersupply terminals for power supply to the mobile terminal and the like.The interface unit 170 may be a card socket for coupling to externalcards, such as a Subscriber Identity Module (SIM), a User IdentityModule (UIM), a memory card for storage of information and the like.

FIG. 2B is a rear perspective view of the mobile terminal 100illustrated in FIG. 2A.

Referring to FIG. 2B, the rear surface of the terminal body is furthershown having a camera 121 a. The camera 121 a faces a direction which issubstantially opposite to a direction faced by the camera 121 b (seeFIG. 2A). Also, the camera 121 a may be a camera having different pixelsfrom those of the camera 121 b.

For example, the camera 121 b may operate with relatively lower pixels(lower resolution). Thus, the camera 121 b may be useful when a user cancapture his face and send it to another party during a video call or thelike. On the other hand, the camera 121 a may operate with relativelyhigher pixels (higher resolution) such that it can be useful for a userto obtain higher quality pictures for later use.

A flash 123 and a mirror 124 may be disposed adjacent to the camera 121a. The flash 123 operates in conjunction with the camera 121 a whentaking a picture using the camera 121 a. The mirror 124 can cooperatewith the camera 121 a to allow a user to photograph himself in aself-portrait mode.

A second audio output module 152 b may further be disposed on the rearsurface of the terminal body. The second audio output module 152 b maycooperate with the first audio output unit 152 a (see FIG. 2A) toprovide stereo output in a phone-call mode, and be used to implement aspeakerphone mode during a call connection.

A broadcast signal receiving antenna (not shown) may further be disposedat the side surface of the terminal body, in addition to an antenna forcall connection. The antenna forming a part of the broadcast receivingmodule may be retractable into the terminal body.

The terminal body is shown having a power supply unit 190 (see FIG. 1)for supplying power to the mobile terminal 100. The power supply unit190 may be implemented as a battery 191 for converting chemical energyinto electrical energy, and the battery may be mounted inside theterminal body or detachably coupled to the terminal body.

As described above, the cameras 121 a and 121 b may be disposed on therear and front surfaces of the terminal body, respectively. Hereinafter,the camera disposed on the rear surface of the terminal body may bereferred to as a first camera 121 a, and the camera disposed on thefront surface of the terminal body may be referred to as a second camera121 a, for the sake of explanation. This is merely illustrative, and thepresent disclosure may not be limited to this. That is, the first andsecond cameras may also be construed as cameras disposed on the frontand rear surfaces of the terminal body, respectively.

FIGS. 3 and 4 are conceptual views illustrating a dual capturing modefor capturing images by simultaneously operating the first and secondcameras 121 a and 121 b illustrated in FIGS. 2A and 2B.

As illustrated in FIG. 3, the mobile terminal 100 may support a generalcapturing mode in which the first camera 121 a and the second camera 121b are operating in an independent manner, and a dual capturing mode inwhich the first and second cameras 121 a and 121 b are operating in asimultaneous manner.

In the dual capturing mode, the first and second cameras 121 a and 121 bmay operate simultaneously, such that the first camera 121 a can capturean object located at the rear side of the terminal body and the secondcamera 121 b can capture an object located at the front side of theterminal body. The drawing illustrates an exemplary use of the dualcapturing mode in which the user (a photographer, i.e., a person whophotographs an image) captures the user's own image while capturing aplurality of figures (persons).

The dual capturing mode may have an advantage in that objects located indifferent directions can be captured and documented. Images captured bythe first and second cameras 121 a and 121 b may be stored in the memory160 (see FIG. 1) as separate images from each other, or by beingcombined into one image. In addition, it may be obvious that an imagefile in a combination form of those images, as well as an image file ofeach image captured by the first and second cameras 121 a and 121 b, mayalso be stored in the memory 160. This storage method may change by auser's setting.

FIG. 4 illustrates that images captured by the first and second cameras121 a and 121 b are output, respectively, on the display unit 151 in thedual capturing mode.

In the dual capturing mode, prior to receiving a control command appliedfor actual capturing (image acquisition), first and second images 151 aand 151 b which are currently captured by the first and second cameras121 a and 121 b may be output on the display unit 151, respectively.This may be understood as a preview state in which the first and secondimages 151 a and 151 b to be captured are shown to the user in advance.The user may change a capturing composition into a desired compositionin the preview state. Also, the display unit 151 may output not only thefirst and second images 151 a and 151 b but also setting information forchanging settings associated with image capturing. Hereinafter, the dualcapturing mode may be a state in which a still image or a video isactually captured or the preview state.

In the dual capturing mode, the controller 180 may control the displayunit 151 to output the first and second images 151 a and 151 b in such amanner that at least part of the second image 151 b captured by thesecond camera 121 b is overlaid on the first image 151 a captured by thefirst camera 121 a.

As illustrated, the at least part of the second image 151 b may beoutput on a floating window 151 b′. The floating window 151 b′ mayarouse a visual effect like floating above the first image 151 a.Accordingly, a part of the first image 151 a, which is overlaid by thefloating window 151 b′, may be invisible due to being obscured by thefloating window 151 b′. The floating window 151 b′ may change inposition depending on situations, which will be explained later.

Meanwhile, the floating window 151 b′ may be provided with an edgeportion for discriminating a boundary between at least part of the innersecond image 151 b and the outer first image 151 a. A color, a shape andthe like of the edge portion may be changed by the user's setting. Thedrawing exemplarily illustrates the floating window 151 b′ without aseparate visual effect given for the edge portion.

As illustrated, when the first camera 121 a captures a person and thesecond camera 121 b captures the user, the floating window 151 b′ may beoutput in a state of being overlaid on a face of the person. In thiscase, the user should change a capturing composition to prevent thefloating window 151 b′ from being overlaid on the person's face, orchange an output position of the floating window 151 b′ throughmanipulation.

Hereinafter, description will be given of the mobile terminal 100, whichis capable of enhancing user convenience by solving the above issue.

FIGS. 5 to 7 are conceptual views illustrating an automatic positionselection for the floating window 151 b′, on which an image captured bythe second camera 121 b is output, in the mobile terminal 100 accordingto the one exemplary embodiment. For reference, FIG. 7 conceptuallyillustrates a process that the controller 180 selects the position ofthe floating window 151 b′.

As illustrated in FIG. 5, the mobile terminal 100 may have a mode forsetting (selecting) a position where the floating window 151 b′ is to beoutput. A setting screen for selecting the mode may be output uponexecution of the dual capturing mode. Of course, the mode may beselectable on a setting screen associated with a camera function.

The controller 180 (see FIG. 1) may set the output position of thefloating window 151 b′, in such a manner of preventing at least part ofthe second image 151 b, which is displayed on the floating window 151b′, from being overlaid on a specific object (an object to be captured)included in the first image 151 a. The controller 180 may also set thefloating window 151 b′ to be output on a previous output positionwithout taking the specific object into account.

Meanwhile, the specific object may be a face of a person who is presentin the first image 151 a captured by the first camera 121 a, or theremay be a plurality of specific objects. However, the specific object maynot be limited to those examples. The specific object may also be athing, a creature, or the like, which meets a particular condition (forexample, movement, color, size, etc.), which may be changed according toa user's setting.

Hereinafter, description will be given in more detail of one example ofa control method for implementing this, with reference to a flowchartillustrated in FIG. 6.

First, the mobile terminal 100 may enter a dual capturing mode inresponse to a user selection (S110). The dual capturing mode may becarried out when a camera-related application is activated. Thecamera-related application may be activated in various manners, such asselecting an icon (or a graphic object) of the camera-relatedapplication output on the display unit 151, combining manipulation andmotion made by a user, and the like.

In response to the entrance of the mobile terminal 100 into the dualcapturing mode, the first and second cameras 121 a and 121 b may beactivated to acquire first and second images 151 a and 151 b,respectively (S120). The display unit 151 may output the first image 151a and the second image 151 b in real time. Here, the display unit 151may also output only a part of an image captured by the second camera121 b. For example, at least part of the second image 151 b may beoutput on the floating window 151 b′ which is output in a manner ofoverlapping a part of the first image 151 a.

While the first camera 151 a acquires the first image 151 a, thecontroller 180 may detect a specific object included in the first image151 a (S130). For example, the controller 180 may be set to detect aface of a person included in the first image 151 a. Here, a frame (forexample, a rectangular or circular dotted line) which surrounds(selects) the face may be output on the detected person's face. When thecontroller 180 fails to detect the face of the person included in thefirst image 151 a, the person's face may be selected by the user. (a) ofFIG. 7 illustrates that the controller 180 has detected faces of aplurality of persons included in the first image 151 a.

If the specific object has not been detected (S140), the controller 180may output the floating window 151 b′, on which at least part of thesecond image 151 b captured by the second camera 121 b is displayed, ona previous position on which the floating window 151 b′ was output uponexecution of the dual capturing mode (S172). If the dual capturing modeis executed for the first time, the floating window 151 b′ may be outputon a position which has been set upon shipping of the mobile terminal.

When the specific object has been detected (S140), the controller 180may detect a background area of the first image 151 a except for thespecific object (S150). For example, the controller 180 may detect therest area of the first image 151 a, except for the face of the personincluded in the first image 151 a, as the background area.

Afterwards, the controller 180 may determine whether or not the floatingwindow 151 b′ can be located on the background area according to apreset logic (S160).

The preset logic may be configured in various manners. For example,various logics may be stored in the mobile terminal 100 such that theuser can select one logic for use. Hereinafter, description will begiven in more detail of an exemplary logic of determining whether or notthe floating window 151 b′ can be located on the background area of thefirst image 151 a and, if possible, setting (selecting) an outputposition of the floating window 151 b′.

As illustrated in (b) of FIG. 7, the controller 180 may divide thebackground area into a plurality of areas a, b, c, d and e, avoiding theperson's face. Here, the plurality of areas a, b, c, d and e may havethe same aspect ratio as the floating window 151 b′. (b) of FIG. 7illustrates the result that the controller 180 has extracted the areasa, b, c, d and e, which have the same aspect ratio as the floatingwindow 151 b′, from the background area, in such a manner of moving fromleft to right and from up to down. Meanwhile, the aspect ratio of thefloating window 151 b′ may differ according to a user's setting, oraccording to an orientation of the mobile terminal 100 from the ground.For example, when the mobile terminal 100 is changed into a horizontalmode (landscape mode) by 90°-rotation from a vertical mode (portraitmode), the aspect ratio may be changed.

The controller 180 may then situate the floating window 151 b′ on one ofthe plurality of areas a, b, c, d and e, and the one area may be an areahaving the largest size of the plurality of areas. Referring to (b) ofFIG. 7, the first area a which meets the logic is extracted on a leftupper end of the background area. The right second area b, which isextracted in a sequential manner, is smaller in size than the first areaa. Hence, the second area b is excluded from those candidates on whichthe floating window 151 b′ is to be located. The next extracted thirdarea c is also smaller in size than the first area a, so as to beexcluded from the candidates. Afterwards, the extracted fourth area d islarger in size than the first area a. Accordingly, the fourth area d isselected as a new candidate area and the first area a is excluded fromthe candidate areas. The last extracted fifth area e is larger in sizethan the fourth area d. Therefore, the fifth area e is finally decidedas the area where the floating window 151 b′ is to be located.

The controller 180 may output the floating window 151 b′ on the fiftharea e which has been decided according to the logic. This exemplaryembodiment illustrates that the floating window 151 b′, on which the atleast part of the second image 151 b is displayed, is output on a centerof the fifth area e by being resized with maintaining the same aspectratio. However, the method of outputting the floating window 151 b′ maynot be limited to this. The floating window 151 b′ may be configured tofully fill the fifth area e, or be resized according to a preset touchinput applied by the user.

In the meantime, if there is not any area which meets the preset logicand on which the floating window 151 b′ can be located [a case where theplurality of divided areas a, b, c, d and e are all smaller than thefloating window 151 b′ in the above example], as aforementioned, thecontroller 180 may output the floating window 151 b′ on the previousposition on which the floating window 151 b′ was output upon executionof the dual capturing mode (S172). Of course, the user may move thefloating window 151 b′ to a specific position in a preset touch manner.

In this manner, in the dual capturing mode, the floating window 151 b′on which the at least part of the second image 151 b is displayed may bearranged by being appropriately resized for a position where it does notinterfere with the face of the person captured by the first camera 121a.

Meanwhile, when the capturing composition is changed, relative positionsbetween the specific object included in the first image 151 a and thefloating window 151 b′ may be changed. Consequently, a case may occurwhere the floating window 151 b′ obscures the specific object due to thechange in the capturing composition. Hereinafter, a method of preventingthis problem will be described.

FIGS. 8 to 10 are conceptual views illustrating a continuous executionof an automatic position selection for the floating window 151 b′ in themobile terminal 100 in accordance with the one exemplary embodiment.

As illustrated in FIG. 8, a mode for setting that at least part of thesecond image 151 b displayed within the floating window 151 b′ isprevented from being overlaid on the specific object may include a submode (or a lower mode) in which it is possible to select whether thesetting is activated only upon driving the dual capturing mode or iscontinuously activated while capturing is carried out.

A setting screen for selecting the sub mode may be output when the atleast part of the second image 151 b displayed within the floatingwindow 151 b′ is touched in a preset manner. For example, as illustratedin FIG. 8, when a touch lasted for more than a preset time is sensed onthe at least part of the second image 151 b, the setting screen may beoutput on the display unit 151. Of course, the sub mode may also beselectable on a setting screen associated with a camera function.

Hereinafter, description will be given in more detail of an example ofdriving the sub mode for continuously activating the setting during thecapturing, with reference to a flowchart illustrated in FIG. 9.

The flowchart illustrated in FIG. 9 may further include, in addition tothose steps included in the flowchart illustrated in FIG. 6, a step ofdetermining whether or not the capturing has been completed afterselecting the output position of the second image 151 b (S280). When thecapturing has not been completed, the controller 180 may go back to thestep of acquiring the first and second images 151 a and 151 b throughthe first and second cameras 121 a and 121 b (S220), and perform thestep of searching for an output position where the second image 151 bdoes not interfere with the specific object included in the first image151 a.

If the position of the specific object output on the display unit 151 ischanged, the at least part of the second image 151 b may be changed inposition with maintaining the state of avoiding the specific object. Thechange in the position may include a change in a size of the specificobject output on the display unit 151. The change in the output positionof the specific object may be caused due to a change in a distancebetween the first camera 121 a and the specific object, a zoom-in/out ofthe first camera 121 a, a change in a capturing angle of the firstcamera 121 a, and the like.

For example, when the user moves the mobile terminal 100 to make anappropriate capturing composition in an activated state of the dualcapturing mode, a position of a face of a person output on the displayunit 151 may be changed. The controller 180 may continuously search forthe appropriate output position, such that the floating window 151 b′can be output on a position where it does not interfere with the face ofthe person captured by the first camera 121 a. The continuous search maybe repeated until the capturing is completed.

According to the control method, the user may feel satisfactory when theuser makes a capturing composition with viewing an object-capturedimage, without caring for whether the floating window 151 b′ interfereswith the capturing by obscuring a specific object. That is, the controlmethod may bring about an increase in user convenience in the dualcapturing mode.

The control method may especially be useful when a composition ischanged during capturing or upon capturing a video in which an object ismoving. Therefore, when a video is captured using the first and secondcameras 121 a and 121 b, the sub mode may be automatically set.

Meanwhile, the floating window 151 b′ may be output on the display unit151 in various sizes. Hereinafter, description will be given of the wayhow the floating window 151 b′ can be output based on the aforementionedlogic [the logic of selecting an area for outputting the floating window151 b′ from the plurality of areas].

FIGS. 11 and 12 are conceptual views illustrating an automatic sizesetting for the floating window 151 b′ in the mobile terminal 100 inaccordance with the one exemplary embodiment.

The controller 180 may be configured to output the floating window 151b′ within an area, which is finally selected by the logic, in a specificratio of the area. The logic is merely proposed as one example, asaforementioned, and may not be construed to limit the presentdisclosure. The control method disclosed herein may also be applied tothe aforementioned logic and the output of the floating window 151 b′ onthe area selected by the logic.

The mobile terminal 100 may have a mode for setting an output size ofthe floating window 151 b′. A setting screen for selecting the mode maybe output when at least part of the second image 151 b displayed withinthe floating window 151 b′ is touched in a preset manner. For example,when the at least part of the second image 151 b is touched for morethan a predetermined time, the setting screen may be output on thedisplay unit 151. The mode may also be selectable on a setting screenassociated with a camera function.

It is illustrated in (a) of FIG. 11 that the mobile terminal 100includes a mode of automatically setting a size of the floating window151 b′, and a mode of setting a size of the floating window 151 b′ to aprevious size which was output upon the execution of the dual capturingmode.

When the mode of automatically setting the size of the floating window151 b′ is selected, as illustrated in (b) of FIG. 11, it may be possibleto select a mode of outputting the floating window 151 b′ in a size witha specific ratio with respect to a size of a selected area and changingthe size of the floating window 151 b′ according to the size of theselected area, which is changed in real time, and a mode of outputtingthe floating window 151 b′ in a size with a specific ratio with respectto a size of an initially selected area and maintaining the output size.

As illustrated in FIG. 12, the selection of the output size of thefloating window 151 b′ may be executed based on a selection result of anoutput position of the floating window 151 b′ (S371). For example, thefloating window 151 b′ may be output on a center of a selected area in asize corresponding to 25% of the selected area. Here, the ratio may bechanged by a user's setting.

Hereinafter, description will be given of exemplary embodiments of acontrol method for producing various effects in the dual capturing modeby applying the aforementioned control method.

FIGS. 13A, 13B and 14 are conceptual views illustrating a method ofmaintaining a state that the floating window 151 b′ is overlaid on aspecific object in the mobile terminal 100 in accordance with the oneexemplary embodiment.

As aforementioned, in the dual capturing mode, the floating window 151b′, within which the at least part of the second image 151 b isdisplayed, may be output on the first image 151 a in a manner of beingoverlaid on a part of the first image 151 a. The foregoing embodimenthas illustrated that the floating window 151 b′ is output not to beoverlaid on the specific object, but these exemplary embodiments proposethat the floating window 151 b′ is output to be continuously overlaid onthe specific object.

As illustrated in FIG. 13A, in a state where the floating window 151 b′is output on the display unit 151 without interfering with faces ofpersons included in the first image 151 a, when a preset touch input isapplied to the floating window 151 b′, a setting screen associated withobject tracking may be output. The preset touch input, for example, maybe a touch input which is applied to at least part of the second image151 b displayed within the floating window 151 b′ for more than a presettime.

When an object tracking mode is selected, the faces of persons detectedmay be selectably displayed on the display unit 151, respectively. Forexample, rectangular dotted line frames 151 c surrounding the faces ofthe persons may be output.

When a face of a specific person is selected by a touch input, thefloating window 151 b′ may be output to be overlaid on the face of thespecific person. Accordingly, the specific person's face may seem to bechanged to the face of the user who is capturing the specific person'sface. That is, an effect similar to a composite image can be produced.

Meanwhile, a more simplified method, which is different from theaforementioned method, may also be employed to track an object. Asillustrated in FIG. 13B, when at least part of the second image 151 bdisplayed within the floating window 151 b′ is touched and dragged, thefloating window 151 b′ may be movable along the drag input. Here, whenthe floating window 151 b′ approaches the specific person's face withina predetermined range, the floating window 151 b′ may be output to beoverlaid on the specific person's face.

During this process, when the floating window 151 b′ approaches thespecific person's face within the predetermined range, the floatingwindow 151 b′ may be attracted to the specific person's face so as to beoverlaid on the face even though the touch onto the floating window 151b′ is released. That is, the floating window 151 b′ may be attracted,like a magnet, to be overlaid on the specific person's face.

According to the method, a selection of an object tracking mode, aselection of an object, and the like may be simultaneously achieved bytouch & drag. Therefore, the method may be very useful in view of acharacteristic of image capturing or video capturing with an emphasis oncatching and recording of unexpected moments.

In the meantime, in order to minimize a sense of difference between thefirst image 151 a and the at least part of the second image 151 bdisplayed within the floating window 151 b′, the second camera 121 b maybe set to the same setting value as the first camera 121 a. For example,when the first camera 121 a is set to a black-and-white capture in theobject tracking mode, the setting value of the second camera 1212 b maybe changed to the black-and-white capture to be the same as the settingvalue of the first camera 121 a. This may be applied to the overall dualcapturing mode as well as the object tracking mode.

Also, the controller 180 may adjust a size of the user's face displayedon the floating window 151 b′ such that the user's face can have asimilar/like size to the selected specific person's face. To implementthis, the size of the floating window 151 b′ or the size of the user'sface displayed on the floating window 151 b′ may be adjustable.

When at least one of a position and a size of a specific object outputon the display unit 151 is changed, at least one of a position and asize of the at least part of the second image 151 b may be changed whileit continuously obscures the specific object. Referring to FIG. 14, thecontroller 180 may move the output position of the floating window 151b′ when the position of the selected person's face is changed, such thatthe floating window 151 b′ can be continuously overlaid on the selectedperson's face even when the output position of the selected person'sface on the display unit 151 is changed.

FIGS. 15 and 16 are conceptual views illustrating a method ofmaintaining a preset interval between the floating window 151 b′ and adesignated specific object in the mobile terminal 100 in accordance withthe one exemplary embodiment.

This exemplary embodiment is a variation of the aforementioned objecttracking method, and propose a method in which the floating window 151b′ is output with maintaining a preset interval from the specificobject.

As illustrated in FIG. 15, in a state where the floating window 151 b′is output on the display unit 151 without being overlaid on faces ofpersons included in the first image 151 a, when a preset touch input isapplied to the floating window 151 b′, a setting screen associated withobject tracking may be output. The preset touch input, for example, maybe a touch input applied to at least part of the second image 151 b formore than a predetermined time.

When an offset tracking mode in which the floating window 151 b′ isoutput with a preset interval from a specific object is selected, thefaces of persons detected may be selectably displayed on the displayunit 151, respectively. For example, rectangular frames 151 csurrounding the persons' faces may be displayed.

When a specific person's face is selected by a touch input, the floatingwindow 151 b′ may be output with a preset interval from the specificperson's face. Also, as illustrated in FIG. 16, when the specificperson's face displayed on the display unit 151 is moved in response toa change in a capturing composition, the floating window 151 b′ may bemoved with maintaining the preset interval from the specific person'sface. Accordingly, it may seem that the user is present with thespecific person.

Here, the preset interval between the specific object and the floatingwindow 151 b′ may be set based on a touch input. For example, when atleast part of the second image 151 b displayed on the floating window151 b′ illustrated in (d) of FIG. 15 is touched and dragged, thefloating window 151 b′ may be moved along the drag input. Afterwards,when the touch is released on a specific point, the controller 180 mayset an interval between the selected person's face and thetouch-released point as the preset interval.

Meanwhile, when the user views an object-captured image, the user may bedifficult to pay attention to an image capturing the userhimself/herself. Further, when a part of the second image 151 b isdisplayed within the floating window 151 b′, the user may feel difficultin placing his/her face within the floating window 151 b′. Hereinafter,description will be given of the mobile terminal 100 which is capable ofincreasing user convenience by solving the issue.

FIGS. 17 to 19 are conceptual views illustrating a method of alwaysplacing a specific object, which is included in the second image 151 bcaptured by the second camera 121 b, within the floating window 151 b′in the mobile terminal 100 in accordance with the one exemplaryembodiment.

As illustrated in FIG. 17, the dual capturing mode may include a submode of selecting whether to output the original second image 151 bcaptured by the second camera 121 b on the floating window 151 b′, or todetect the user's face included in the second image 151 b and place thedetected user's face within the floating window 151 b′. Upon selecting amode of always placing the user's face on a center of the floatingwindow 151 b′, the user may not need to care for whether he/she islocated properly within the floating window 151 b′. This may result inan increase in user convenience in the dual capturing mode.

Hereinafter, an exemplary embodiment of a control method forimplementing this will be described in more detail with reference to aflowchart illustrated in FIG. 18.

As illustrated in FIG. 18, when the mobile terminal 100 enters the dualcapturing mode in response to a user selection (S410), the first andsecond cameras 121 a and 121 b may be activated to acquire the first andsecond images 151 a and 151 b, respectively (S420). The first image 151a and the second image 151 b may be output on the display unit 151 inreal time. Here, the display unit 151 may output a part of an imagecaptured by the second camera 121 b. For example, at least part of thesecond image 151 b may be displayed within the floating window 151 b′which is output in a manner of being overlaid on a part of the firstimage 151 a.

While the second camera 121 b captures the second image 151 b, thecontroller 180 may detect a specific object included in the second image151 b (S430). For example, the controller 180 may be set to detect aface of a person (user) included in the second image 151 b. Here, thedetected face of the person may be output along with a frame (forexample, a rectangular or circular edge) surrounding the face. When thecontroller 180 fails to detect the user's face included in the secondimage 151 b, the user's face may be selected by the user.

If the user's face has not been detected (S440), the controller 180 maydisplay at least part of the second image 151 b captured by the secondcamera 121 b on the floating window 151 b′, and keep monitoring whetheror not the user's face is included in the second image 151 b.

When the user's face has been detected (S440), the controller 180 maydecide an area to be displayed within the floating window 151 b′ basedon the user's face. For example, a preset area based on a center of thedetected user's face may be decided as the area to be displayed withinthe floating window 151 b′.

As illustrated in FIG. 19, when relative positions between the secondcamera 121 b and the user's face are changed, the area to be displayedmay be changed accordingly. For example, when a capturing composition ofthe second camera 121 b is changed due to the movement of the mobileterminal 100, the preset area based on the center of the detected user'sface may be continuously monitored and displayed within the floatingwindow 151 b′.

Afterwards, the controller 180 may decide whether or not to performbackground processing (S460). The background processing may refer tooutputting only the user's face of the second image 151 b on the displayunit 151. Whether or not to perform the background processing may bepreset. Or, a popup window which asks for whether or not to perform thebackground processing may be set to be open when the user's face isrecognized.

When the background processing is performed, the controller 180 maydetect a background area except for the user's face from the presetarea. Afterwards, the controller 180 may process the background area tobe transparent or cut off the background area such that the first image151 a which overlaps the background area is exposed.

When the background processing is not performed, the controller 180 maydisplay shooting information (or screen information) within the presetarea, on the floating window 151 b′.

According to the aforementioned control method, the user's face may bealways located within the floating window 151 b′, which may facilitatethe user to do the dual capturing in a convenient manner. When thebackground processing is performed, the user's face captured by thesecond camera 121 b can be more harmonized with the first image 151 a.For example, when the control method is applied to the aforementionedobject tracking mode, it may arouse a more natural feeling.

Hereinafter, a method of displaying a specific object in an appropriatesize within the floating window 151 b′ will be described.

FIGS. 20 to 22 are conceptual views illustrating a method of outputtinga specific object, which is included in the second image 151 b capturedby the second camera 121 b, in a manner of adjusting a size of thespecific object to be appropriate for the floating window 151 b′according to sizes of objects included in the first image 151 a capturedby the first camera 121 a in the mobile terminal 100 in accordance withthe one exemplary embodiment.

As illustrated in FIG. 20, the dual capturing mode may include a submode of setting how large or small the user's face captured by thesecond camera 121 b is output. For example, the sub mode may be a modeof setting a user's face to an average face size of persons captured bythe first camera 121 a, or setting the user's face to a selectedspecific person's face.

The sub mode may reduce an unnatural feeling, which results from adifference between a size of the person's face captured by the firstcamera 121 a and a size of the person's face captured by the secondcamera 121 b.

Hereinafter, description will be given in more detail of an exemplaryembodiment of a control method of setting the user's face to the averageface size of the persons captured by the first camera 121 a.

As illustrated in FIG. 21, when the mobile terminal 100 enters the dualcapturing mode in response to a user selection (S510), the first andsecond cameras 121 a and 121 b may be activated to acquire first andsecond images 151 a and 151 b, respectively (S520). The display unit 151may output the first image 151 a and the second image 151 b in realtime.

While the first camera 121 a captures the first image 151 a, thecontroller 180 may detect a specific object included in the first image151 a (S530). For example, the controller 180 may be set to detect aface of a person included in the first image 151 a.

When the person's face has not been detected (S540), at least part ofthe second image 151 b may be output in the same size on a positionwhere it was output previously (S582). That is, the user's face includedin the second image 151 b may also be output in the same size as theprevious size.

When the person's face has been detected (S540), a frame (for example, arectangular or circular edge) surrounding the face may be output on theperson's face. When the controller 180 fails to detect the person's faceincluded in the first image 151 a, the person's face may be selected bythe user. FIG. 22 illustrates that the controller 180 detects faces ofpersons included in the first image 151 a and the detected faces aredisplayed within rectangular frames 151 c.

Afterwards, the controller 180 may detect sizes of the detected persons'faces and calculate an average value of those sizes (S550).

Next, the controller 180 may detect the user's face included in thesecond image 121 b and a size of the user's face (S560). The frame (forexample, a rectangular or circular edge) surrounding the face may beoutput on the detected user's face. When the controller 180 fails todetect the user's face included in the second image 151 b, the user'sface may be selected by the user.

Afterwards, the controller 180 may adjust the size of the user's faceincluded in the second image 151 b based on the calculated average value(S581). For example, when the average value is smaller than the size ofthe user's face, the controller 180 may display the user's face on thefloating window 151 b′ by reducing the size of the user's face withmaintaining a ratio.

According to the control method, the user's face captured by the secondcamera 121 b may be more harmonized with the person's face captured bythe first camera 121 a.

Meanwhile, the aforementioned display methods for the second image 151 bmay be employed in the form of combination. Also, the displaying methodfor the second image 151 b may be set to be driven in the overall dualcapturing mode. For example, when the displaying method for the secondimage 151 b is applied to the object tracking mode, displayed images canarouse a more natural feeling of a composite photograph.

In accordance with the present disclosure, in the dual capturing mode,an output position of a floating window displayed on an image capturedby a second camera may be set based on a position of a specific objectcaptured by a first camera. For example, the floating window may bearranged in an appropriate size on a position where it is not overlaidon a face of a person captured by the first camera. Also, the floatingwindow may be configured to continuously track a user-selected specificobject, and a user's face may be placed in an appropriate size withinthe floating window.

Accordingly, the user may feel satisfactory when the user makes acapturing composition with viewing an image with an object captured,without caring for positions of images output on a display unit andwhether the user is positioned appropriately within the floating window.In this manner, the present disclosure may arouse an increase in userconvenience in the dual capturing mode.

The configurations and methods of the mobile terminal and the controlmethod thereof in the aforesaid embodiments may not be limitedlyapplied, but such embodiments may be configured by a selectivecombination of all or part of the embodiments so as to implement manyvariations.

What is claimed is:
 1. A mobile terminal comprising: a first camera; asecond camera; a display; and a controller configured to: cause thedisplay to display a first image captured by the first camera, the firstimage comprising a specific object; and cause the display to display asecond image captured by the second camera, wherein the second image isdisplayed to overlap only a portion of the displayed first image and notobscure the specific object of the first image; wherein the first imageand the second image are captured simultaneously.
 2. The mobile terminalof claim 1, wherein: the specific object is a face of a person displayedin the first image; and the controller is further configured to:identify a background area of the first image, wherein the backgroundarea excludes the specific object; identify a plurality of candidatedisplay positions on the background area where the second image could bedisplayed without obscuring the specific object, and select one of theplurality of candidate display positions for displaying the secondimage.
 3. The mobile terminal of claim 1, wherein the controller isfurther configured to change a position of the second image when aposition of the specific object changes in the first image such that thesecond image in the changed position does not obscure the specificobject.
 4. The mobile terminal of claim 1, wherein the controller isfurther configured to change a position of the second image to obscurethe specific object in response to a received input.
 5. The mobileterminal of claim 4, wherein: the display comprises a touchscreen; thereceived input comprises a touch and drag input for moving the secondimage; and the controller is further configured to cause the secondimage to overlap the specific object when the second image is movedwithin a threshold distance from the specific object.
 6. The mobileterminal of claim 5, wherein the controller is further configured tochange a size or the position of the second image to correspond to asize or a position of the obscured specific object such that thespecific object remains obscured when the size or the position of thespecific object is changed.
 7. The mobile terminal of claim 1, whereinthe controller is further configured to change a position of the secondimage when a position of the specific object is changed such that thesecond image is displayed at a constant distance apart from the specificobject.
 8. The mobile terminal of claim 7, wherein: the displaycomprises a touchscreen; and the controller is further configured to:change the position of the second image in response to a touch inputcomprising a touch and drag input for moving the second image; and setthe constant distance to a distance between the changed position of thesecond image and the specific object.
 9. The mobile terminal of claim 1,wherein: the second image is a portion of a total second camera imagecaptured by the second camera; and the controller is further configuredto set the second image based on a position of a face of a persondetected in the total second camera image.
 10. The mobile terminal ofclaim 9, wherein the controller is further configured to: identify abackground area of the second image, wherein the background areaexcludes the detected face of the person; and cause the display todisplay the second image such that the background area is transparentand a portion of the first image overlapped by the background area isvisible.
 11. The mobile terminal of claim 1, wherein the specific objectis a first face of a first person displayed in the first image, and thecontroller is further configured to change a size of a second face of asecond person displayed in the second image based on a size of the firstface.
 12. A control method for a mobile terminal, the method comprising:capturing a first image via a first camera of the mobile terminal;capturing a second image via a second camera of the mobile terminalsimultaneously with the first image being captured; displaying on adisplay the first image comprising a specific object; and displaying onthe display the second image to overlap only a portion of the displayedfirst image, wherein a position of the second image is based on aposition of the specific object of the first image.
 13. The method ofclaim 12, wherein the position of the second image is set such that thesecond image does not obscure the specific object of the first image.14. The method of claim 12, further comprising changing a size or theposition of the second image when a size or a position of the specificobject is changed.
 15. The method of claim 14, wherein the position ofthe second image is changed such that the second image is displayed at aconstant distance apart from the specific object when the position ofthe specific object is changed.
 16. The method of claim 15, furthercomprising: changing a position of the second image in response to atouch input comprising a touch and drag input for moving the secondimage; and setting the constant distance to a distance between thechanged position of the second image and the specific object.
 17. Themethod of claim 12, further comprising: detecting a face of a person ina total second camera image captured by the second camera; and settingthe second image as a portion of the total second camera image based ona position of the detected face within the total second camera image.18. The method of claim 17, further comprising: identifying a backgroundarea of the second image, wherein the background area excludes thedetected face of the person; and displaying the second image such thatthe background area is transparent and a portion of the first imageoverlapped by the background area is visible.
 19. The method of claim12, further comprising: detecting a first face of a first person in thefirst image; detecting a second face of a second person in the secondimage; and changing a size of the second face based on a change of asize of the first face.
 20. The method of claim 12, further comprisingchanging the position the second image to overlap the specific objectwhen the second image is moved within a threshold distance from thespecific object in response to a touch input.